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ABSTRACT 

The  Department  of  Defense  has  historically  favored  a 
relatively  simple  parametric  approach  to  cost  estimation. 
Economic  theory  has  largely  been  ignored  and  the  learning 
curve  has  become  the  customary  analytical  tool  for  relating 
production  quantities  to  airframe  costs.  This  research 
examines  an  effort  to  synthesize  neoclassical  economic 
theory  with  the  traditional  learning  curve  methodology.  The 
proposed  model  implements  a  dynamic  cost  function  that 
considers  the  effects  of  learning  and  production  rate  on  the 
production  process.  To  empirically  test  its  validity,  the 
model  is  applied  to  the  F-4  Phantom  II  production  program 
and  parameters  are  estimated  using  historical  production 
data  . 
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I  .   INTRODUCTION 

As  we  are  reminded  on  an  all  too  frequent  basis,  weapons 
systems  acquisitions  by  the  Department  of  Defense  (DoD)  have 
been  plagued  by  a  series  of  cost  overruns.  With  the  current 
political  climate  of  intense  scrutiny  of  government 
expenditures  in  an  effort  to  shrink  the  federal  budget  and 
battle  record  deficits,  the  DoD  can  ill  afford  any  such 
adverse  publicity.  Some  of  the  implications  of  continued 
deficient  cost  estimation  are  particularly  disturbing. 
Using  pessimistic  cost  estimates  that  encompass  all 
uncertainty  will  minimize  the  chance  of  a  cost  overun  by 
providing  cost  estimates  that  are  consistently  too  high. 
Of  real  concern  is  the  possibility  that  these  unnecessarily 
high  estimates  might  become  self-fulfilling  prophecies. 
Such  cost  estimates  might  also  prompt  a  decision  to  invest 
in  an  alternative  system  that  is  less  costly  but  also  less 
cost  ef f ect ive--the  end  result  would  be  an  inefficient 
allocation  of  valuable  economic  resources.  At  the  other 
extreme,  a  cost  estimate  that  is  too  low  can  lead  to 
insufficient  funding  which,  if  not  supplemented,  could  delay 
deliveries  of  needed  weapons  or  prematurely  terminate 
production  at  output  quantities  that  are  less  than  optimal. 
Another  effect,  with  possibly  more  serious  consequences,  is 


the  possible  erosion  of  public  trust  in  our  military  forces 
if  the  public  perceives  mismanagement  and  waste  are 
perceived  to  be  the  source  of  cost  overruns. 

Some  of  our  cost  estimation  difficulties  stem  from 
design  changes  or  improvements  that  occur  after  a  cost 
analyst  has  formulated  an  estimate  of  a  program's  cost. 
Such  problems  are  beyond  the  analyst's  control; 
unfortunately,  cost  estimation  problems  have  occurred  in 
many  programs  that  didn't  experience  such  changes.  A 
possible  conclusion  is  that  our  current  cost  estimation 
methodology  is  inadequate  and  that  a  better  understanding  of 
the  factors  that  determine  cost  is  required. 

Current  methods  of  cost  estimation  can  be  divided  into 
two  approaches:  (1)  the  "topdown"  or  statistical  approach 
which  generates  simple,  imprecise  estimates  based  on 
existing  similar  systems  and  which  is  insensitive  to  many 
production  decisions  and  (2)  the  "bottom  up"  or  industrial 
engineering  approach  which  examines  separate  segments  of 
work  in  great  detail  and  synthesizes  these  estimates  into  a 
complex,  yet  often  imprecise,  total  cost  estimate  which 
requires  substantial  revision  when  changes  occur.  Neither 
of  these  approaches  is  particularly  helpful  to  a  program 
manager  who  must  develop  a  funding  profile  suitable  for 
projected  lot  release  dates  and  delivery  schedules  and  then 
deal  with  subsequent  changes  in  funding  or  production 
schedule . 


This  paper  concentrates  on  a  model  developed  principally 
by  Gulledge  and  Womer  [Pef.  1]  that  strives  to  model  the 
factors  influencing  the  cost  of  airframe  production.  In 
particular,  the  influences  of  production  rate  and  delivery 
schedule,  as  well  as  the  standard  learning  effects,  are 
thought  to  significantly  affect  program  costs.  These 
factors,  together  with  basic  economic  theory,  are 
incorporated  into  a  model  which  aspires  to  encourage  wiser 
acquisition  policy  by  providing  greater  sensitivity  to 
alternative  policy  decisions.  The  chapters  that  follow  will 
provide  a  historical  perspective  of  cost  estimation 
methodology,  review  the  proposed  model,  evaluate  its 
performance  using  data  on  F-4B  airframes  purchased  by  the 
Navy,  and  investigate  the  model's  applications. 


II .   HISTORICAL  PERSPECTIVE 

The  DoD  has  historically  favored  a  relatively  simple 
parametric  approach  to  cost  estimation.  Costs  are  modeled 
as  a  function  of  only  a  few  aircraft  design  and  performance 
characteristics  and  unit  costs  are  expected  to  decrease  as 
learning  accumulates  with  production  experience.  The  model 
considered  in  this  paper  is  unique  in  that  it  attempts  to 
model  the  effects  of  production  rates  as  well  as  learning 
and,  implicitly,  the  effects  of  facility  size  on  total 
program  costs.  Thus,  it  is  an  integration  of  what  have 
generally  been  two  distinct  approaches  to  cost  estimation: 

(1)  the  neoclassical  economic  approach  which  purports 
production  rate  to  be  a  significant  determinant  of  cost  and 

(2)  engineering  cost  studies  which  rely  heavily  on  the 
learning  curve  to  relate  costs  to  the  number  of  items 
produced  but  not  to  the  rate  at  which  they  are  produced. 

Economic  theory  typically  depicts  the  relationship 
between  unit  production  costs  and  output  per  production 
period  as  a  U-shaped  function.  Such  a  shape  indicates  that, 
as  the  level  of  output  increases,  unit  costs  fall  over  a 
certain  range  and  then  begin  to  rise.  This  reflects  the 
powerful  logic  of  the  law  of  diminishing  returns  which,  as 
explained  by  Samuelson  [Ref.  2],  says 


An  increase  in  some  inputs  relative  to  other  fixed  inputs 
will,  in  a  given  state  of  technology,  cause  total  output 
to  increase;  but  after  a  point  the  extra  output  resulting 
from  the  same  additions  of  extra  inputs  is  likely  to 
become  less  and  less.  This  falling  off  of  extra  returns 
is  a  consequence  of  the  fact  that  new  "doses"  of  the 
varying  resources  have  less  and  less  of  the  fixed 
resources  to  work  with. 

Johnston  [Ref.  3]  cites  the  concept  of  diminishing  marginal 
product  as  one  of  the  most  common  generalizations  of  the  law 
of  diminishing  returns.  Diminishing  marginal  product  refers 
to  the  eventual  decreasing  increments  in  output  that  occur 
when  the  quantity  of  an  input  is  increased  by  equal 
increments,  with  all  other  input  quantities  remaining  fixed. 
A  tendency  for  varying  factors  to  show  diminishing  returns 
when  applied  to  fixed  factors  implies  a  tendency  for 
marginal  cost  to  be  rising.  If  at  first  there  are 
increasing  returns,  there  are  also  declining  marginal 
costs--but  ultimately  diminishing  returns  and  increasing 
marginal  cost  will  prevail.  Such  a  formulation  is  consis- 
tent with  the  notion  that,  for  a  firm  operating  in  perfectly 
competitive  product  and  factor  markets,  marginal  cost  at 
equilibrium  must  be  rising. 

The  implication  of  diminishing  returns  for  an  airframe 
cost  model  is  reasonably  clear.  An  increase  in  production 
rate  will,  at  least  in  the  short  term,  require  additional 
labor.  Since  the  production  facility  itself  must  be 
considered  fixed,  consider  two  alternatives  proposed  by 
Washburn   [Ref.   4]   that   could   be   used   to   increase   the 
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production  rate:  (1)  overtime  or  weekend  work  where  a 
premium  is  paid  for  labor  at  odd  hours;  or  (2)  hiring 
additional  manpower  at  a  loss  of  efficiency  due  to  crowding/ 
scheduling,  etc.  Economic  theory  thus  leads  us  to  the 
conclusion  that  production  rate  and  production  costs  are 
positively  related;  that  is,  with  higher  production  rates, 
labor  is  more  costly  and/or  less  efficient,  and,  as  a 
consequence,  costs  per  unit  of  output  increase.  While 
firmly  grounded  in  economic  theory,  this  conclusion  has 
suffered  from  a  lack  of  empirical  verification. 

In  contrast  to  the  neoclassical  approach  is  the 
engineering  cost  study  technique  which  incorporates  the 
progress  function  or  learning  curve  concept  developed  by 
Wright  [Ref.  5].  In  his  pioneering  analysis  of  aircraft 
production  costs,  Wright  noted  that  labor  hours  per  unit  of 
output  decreased  as  cumulative  output  increased  and  proposed 
the  function  F  =  N  (F  is  a  factor  of  cost  variation 
proportional  to  N,  the  quantity  produced;  X  is  a  learning 
parameter)  to  explain  the  labor  cost-production  quantity 
relationship.  Wright's  data  were  consistent  with  the  eighty 
percent  learning  curve  which  has  received  widespread 
acceptance  as  an  industry  "standard".  As  explained  by 
Wright,  greater  production  improves  worker  efficiency  and 
makes  additional  tooling  economically  feasible  so  that  a 
firm  incurs  only  an  eighty  percent  increase  in  labor  costs 
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when  output  is  doubled.  It  should  be  noted  that  Wright's 
research  and  the  factors  derived  assumed  that  no  major 
changes  would  be  introduced  during  production. 

It  is  readily  apparent  that  production  rate  and  pro- 
duction quantity  are  positively  correlated  so  it  seems  that 
these  two  approaches  to  cost  estimation  are  contradictory. 
The  first  hypothesizes  that  unit  production  costs  are 
directly  related  to  the  rate  of  production  while  the  second 
hypothesizes  that  unit  production  costs  are  inversely 
related  to  the  cumulative  volume  of  production  which,  in 
turn,  is  directly  related  to  the  rate  of  production. 
Further  complicating  the  puzzle  is  that  the  first  approach 
is  based  on  solid,  well-accepted  economic  theory  with  little 
empirical  support  while  the  other  is  seemingly  adopted  to 
explain  the  data  and  has  little  theoretical  underpinnings. 

Numerous  research  efforts  have  been  undertaken  to 
investigate  the  ambiguity  of  the  cost/quantity/rate 
relationship.  In  Asher's  [Ref.  6]  study  of  cost-quantity 
relationships  in  airframe  production,  he  concluded  that  the 
conventional  learning  curve  may  not  be  an  entirely  accurate 
description  of  the  relationship  between  unit  cost  and 
cumulative  output.  For  certain  values  of  cumulative  output, 
he  found  that  the  labor  cost  curve  became  convex  which  would 
be  consistent  with  the  diminishing  returns  expected  by  the 
economist's  approach. 
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In  subsequent  research,  Alchian  [Ref.  7]  reformulated 
the  traditional  cost  function  to  explain  much  of  this 
apparent  contradiction.  While  acknowledging  that  all  of  the 
characteristics  of  a  production  operation  can  affect  its 
cost,  Alchian  directs  attention  to  x(t)--the  rate  of  output, 
V  —  the  total  contemplated  volume  of  output,  T  —  the  first 
scheduled  delivery  date,  and  m--the  time  interval  between 
the  first  and  last  scheduled  deliveries.  These  four 
characteristics  comprise  the  input  variables  for  the  Alchian 
cost  function,  C  =  f(V,x,T,m).  On  this  function  are  based 
Alchian1 s  nine  propositions  to  explain  the  cost-quantity 
relationship.    All  other  factors  being  fixed,  Alchian 

contends  that:   (1)  3C/3x(t)  >  0,  cost  varies  directly  with 

2     2 
production  rate;   (2)  3  C/3x   >  0,  the  increment  in  cost  is 

an  increasing  function  of  production  rate;  "(3)  3C/3V  >  0, 

cost  varies  directly  with  the  total  anticipated  volume  of 

2     2 

outpUT;  (4)  3  C/3V   <  0,  the  increment  in  cost  is  a  decreas- 
ing function  of  total  volume;   (5)  3(C/V)/3V  <  0,  cost  per 

2 
unit  decreases  as  total  volume  increases;  (6)  3  V/3V3X  <  0, 

marginal  discounted  cost  of  increased  quantity  of  output 

decreases  as  production  rate  increases;  (7)  3C/3T  <  0,  cost 

varies  inversely  with  the  elapsed  time  until  first  delivery; 

(8)  all  derivatives   in  propositions   1-5   are  diminishing 
functions  of  T,  but  not  all  diminish  at  the  same  rate;  and 

(9)  the  cost  of  future  output  declines  as  the  total  quantity 
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produced  increases.  Propositions  1,  2,  3,  7  can  be  said  to 
encompass  the  notion  of  diminishing  returns  put  forth  by  the 
conventional  economic  approach  while  propositions  4,  5,  6,  9 
support  the  learning  curve  notion  of  decreasing  unit  costs 
as  total  volume  increases.  Even  without  the  learning 
effect,  Alchian  felt  that  8C/3V  would  be  decreasing.  This 
second  type  of  cost  saving  depends  on  scheduling  larger 
volumes  of  production  in  advance  which  may  allow  a  reduction 
in  capital  cost  or  operating  costs  per  unit. 

As  further  explained  by  Hirshleifer  [Ref.  8],  the  key 
idea  is  that  cost  can  be  regarded  as  a  function  of  the 
quantity  of  output  in  two  different  dimensions:  the  rate  of 
output  and  the  scheduled  volume  of  output.  The  first  of 
these  is  a  flow  measure  while  the  second  is  a  stock  measure 
and,  as  pointed  out  by  Alchian  [Ref.  7],  the  response  of 
cost  to  changes  in  the  one  direction  is  qualitatively 
different  from  the  response  to  changes  in  the  other 
dimension  of  output.  Thus,  marginal  cost  can  always  be  a 
rising  function  of  the  rate  of  output,  volume  held  constant, 
and  a  falling  function  of  output  volume,  rate  being  held 
constant,  and  neither  of  the  aforementioned  theories  of  cost 
estimation  is  contradicted. 

In  their  research  of  Alchian' s  proposals,  Preston  and 
Keachie  [Ref.  9]  contrasted  the  U  or  L-shaped  curve 
typically  used  in  economic  analysis  to  depict  the  unit  cost- 
production  rate  relationship  with  the  hyperbolic  learning 
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curve  that  models  unit  costs  as  a  continuously  decreasing 
function  of  total  output.  The  learning  curve  approach  was 
discredited  for  ignoring  the  effects  of  production  rate. 
They  felt  the  production  rate  could  not  be  assumed  constant 
nor  could  it  be  considered  an  immaterial  factor  of  unit 
costs.  Their  suggested  integration  of  the  economist's  cost 
function  and  the  learning  curve  involves  three  variables: 
C.,  the  level  of  production  costs  for  a  production  period; 
q .  ,  the  amount  of  output  per  production  period;  and  V,  the 
accumulated  level  of  output.  Their  cost  function  can  be 
displayed  graphically  as 


Figure  1.   Integrated  Cost  Function 
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The  U-shaped  curve  shows  the  combined  effects  of  the 
spreading  of  fixed  costs  and  the  gradual  rising  rate  of 
variable  costs,  while  the  downward  slope  with  respect  to  V 
shows  the  learning  effect. 

Using  a  similar  approach,  Cox  and  Gansler  [Ref.  10] 
noted  that  a  move  from  a  relatively  inefficient  g  to  one 
near  the  optimum  results  in  more  rapid  cost  decreases  than 
would  have  resulted  from  a  standard  cost  improvement  curve. 
Conversely,  a  move  from  an  efficient  g.  near  the  optimum  to 
a  less  efficient  rate  some  distance  from  the  optimum  results 
in  a  reduced  rate  of  cost  improvement  from  what  we  would 
expect  from  a  standard  cost  improvement  curve.  A  cost 
increase  could,  and  would,  result  if  the  new  production  rate 
is  significantly  different  from  the  previous,  more  efficient 
rate. 

As  is  becoming  apparent,  the  interrelationship  of 
production  rate  and  the  total  volume  of  output  is  quite 
complicated  and  difficult  to  unravel.  Alchian's  postulates 
are  theoretically  sound  but  empirically  unvalidated  due  to 
the  nature  of  cost  data  and  the  complexity  of  the  rela- 
tionship. For  example,  when  both  volume  and  rate  of  output 
change  in  the  same  direction,  Alchian's  postulates  are 
inconclusive — the  two  expected  effects  work  in  opposite 
directions  and  the  net  result  cannot  be  reliably  predicted. 
It  has  also  been  shown  that  both  the  magnitude  and  direction 
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of  change  in  unit  cost  depend  upon  the  extent  of  movement 
toward  or  away  from  the  optimal  production  rate  when  a  rate 
change  is  required. 

Considering  the  intricacy  of  this  cost-quantity-rate 
relationship,  it  is  not  surprising  that  several  studies  have 
found  contradictory  results.  Large  et .  al .  [Ref.  11]  were 
forced  to  conclude  that  the  influence  of  production  rate 
could  not  be  predicted  with  confidence  and  could  probably  be 
ignored  since  other  uncertainties  prevailed.  Their  analysis 
found  that  rate  effects  were  often  negligible  and  sometimes 
contrary  to  the  a  priori  notion  that  production  rate  and 
unit  costs  were  inversely  related.  They  also  noted  that 
high  volume,  high  production  rate  programs  were  not  typical 
of  recent  DoD  aircraft  procur ements--of  the  29  acquisition 
programs  they  surveyed,  18  had  production  runs  of  less  than 
500  and  only  eight  had  production  runs  of  greater  than  1000. 
This  provides  empirical  evidence  that  production  facilities 
are  typically  not  built  to  sustain  high  production  rates  and 
lends  credence  to  Washburn's  previously  cited  contention 
that  raising  the  production  rate  requires  hiring  additional 
labor  at  a  premium  since  the  production  facility  itself  is 
fixed  . 

Research  by  Smith  [Ref.  12]  and  later  by  Congleton  and 
Kinton  [Ref.  13]  used  the  cost  function 


8     62 
Cost  =  SqX-j^    X2 


(1.1) 
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where    8q  =  cost  of  first  unit 

X,  =  cumulative  quantity  produced 
8-,  =  slope  of  quantity/cost  curve 
X„  =  rate  of  production 
82  =  slope  of  rate/cost  curve 

and  found  unit  costs  to  be  significantly  and  negatively 
correlated  with  production  rate.  Bemis  [Ref.  14]  obtained 
similar  results  with  his  model  for  examining  the  effects  of 
production  rate  on  the  cost  of  many  defense  items.  Cox  and 
Gansler's  [Ref.  10]  study  of  tactical  missile  programs  found 
both  positive  and  negative  correlation  of  unit  costs  with 
production  rate. 

Womer  [Ref.  15]  postulates  that  analyses  such  as  these 
that  conclude  that  unit  costs  decrease  as  the  rate  of 
production  increases  (i.e.,  increasing  returns  to  scale)  are 
inconsistent  with  or  ignore  optimal  contractor  behavior.  As 
noted  by  Washburn  [Ref.  4],  consistently  increasing  or  even 
proportional  returns  to  scale  would,  in  the  presence  of 
discounting,  lead  to  an  optimal  production  program  that 
crowds  all  production  into  an  arbitrarily  short  period  at 
the  very  end. 

In  a  model  which  predates  the  one  considered  in  this 
thesis,  Womer  [Ref.  15]  incorporates  the  research  of  both 
Alchian  [Ref.  7]  and  Washburn  [Ref.  4]  into  a  production 
function   that   relates   the   rate  of   resource   use   and 
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cumulative  production  experience  to  the  output  rate  while 
being  consistent  with  logical  contractor  behavior.  The 
following  production  function  is  specified: 

q(t)  =  AQ5(t) x1/Y(t)  (1.2) 

where    q(t)  =  output  rate  at  t 

Q(t)  =  cumulative  output  at  t 

x(t)  =  rate  of  variable  resource  use  at  t 

5  =  learning  parameter;  0  _<  6  _<  1 

Y  =  returns  to  scale  parameter;  y    >  1 

A  =  a  constant,  A  >  0 

By  restricting  y  to  values  greater  than  one,  it  is  assumed 
that  diminishing  returns  exist  for  the  variable  resource 
which  insures  that  the  model  makes  economic  sense.  It  is 
this  key  assumption  that  distinguishes  Womer's  model  from 
most  others.  Solving  this  production  function  for  x(t)  and 
integrating  over  time  yields  the  amount  of  the  variable 
resource  used  during  the  time  period  in  question.  This 
quantity  is  used  as  the  dependent  variable  in  the  model 
formulated  by  Gulledge  and  Womer  [Ref.  1]  .  It  is  this 
model,  which  seeks  to  combine  the  economist's  theories  on 
production  rate  effects  with  the  learning  effects  of 
cumulative  production,  that  the  remainder  of  this  paper  is 
devoted  to  . 
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III.   THE  MODEL 

The  model  considered  in  this  thesis  was  developed  by 
Gulledge  and  Womer  [Ref.  1]  in  an  effort  to  provide  a 
sensible  explanation  of  the  joint  effects  of  learning  and 
production  rate  on  airframe  production  costs.  It  was  their 
perception  that  existing  models  were  extremely  limited  by  an 
inability  to  consider  production  policy  changes  which  often 
occur  prior  to  or  during  the  course  of  a  production  program. 
Such  static  models  could  be  of  only  limited  use  to  a  program 
manager  forced  to  contend  with  changes  in  funding  and/or 
production  schedules.  The  thrust  of  their  research  was 
therefore  to  provide  a  model  capable  of  capturing  the  rela- 
tionship between  total  program  cost  and  both'  endogenous  and 
exogenous  production  rate  changes  that  inevitably  occur  in 
the  course  of  a  production  period.  Much  of  the  ensuing 
description  and  derivation  of  the  model  is  extracted  from 
Gulledge  and  Womer1 s  [Ref.  16]  explanation  of  their  revised 
model . 

Womer  and  Gulledge  identified  four  means  by  which 
production  scheduling  might  affect  production  efficiency 
and,  therefore,  cost.  The  first  production  cost  driver  is 
the  usual  concept  of  learning  by  doing.  To  help  explain 
this  effect  and  the  production  cost  drivers,  Washburn's 
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[Ref.  4]  concept  of  a  production  line  is  incorporated  as  a 
frame  of  reference.  Learning  by  doing  affects  costs  by 
affecting  the  efficiency  of  each  position  along  the 
production  line.  That  is,  as  the  cumulative  number  of 
airframes  passing  each  position  increases,  experience  and 
efficiency  at  the  position  increase  and  unit  costs  (or  at 
least  labor  hours)  will  decrease.  This  process  implies  that 
at  any  point  in  time  the  experience  on  the  production  line 
could  vary  significantly. 

The  second  production  cost  driver  is  a  different 
learning  effect.  With  the  passage  of  time,  learning  may 
occur  as  a  result  of  events  other  than  experience  at  a 
position  on  the  production  line.  For  example,  labor  hours 
may  be  devoted  specifically  to  improving  or  refining  the 
technique  of  a  particular  work  station  in  the  early  stages 
of  a  production  program.  Later  in  the  program,  this  may 
result  in  increased  efficiency  independent  of  experience  at 
a  given  point  on  the  line.  Positions  at  the  end  of  the  line 
may  work  more  efficiently  on  the  same  airframe  than 
positions  at  the  beginning  of  the  line.  This  effect  might 
also  arise  from  experience  at  other  locations  on  the 
production  line.  In  this  case,  positions  late  in  the 
production  line  benefit  from  the  experience  of  earlier 
positions  and  work  at  these  later  positions  is  accomplished 
more  efficiently. 
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A  third  production  cost  driver  is  the  speed  of  the 
production  line.  Unless  compensated  by  learning,  an 
increase  in  the  speed  of  the  line  is  expected  to  require 
more  labor  at  each  position  on  the  line.  Due  to  the 
presence  of  diminishing  returns,  such  increases  in  labor  are 
expected  to  be  more  than  proportional  to  the  increase  in 
speed . 

The  fourth  cost  driver  is  the  length  of  the  production 
line.  One  means  of  boosting  the  delivery  rate  is  to 
increase  the  number  of  positions  along  the  production  line. 
This  reduces  the  workload  per  position  and  increases  the 
total  amount  of  work  done  per  unit  of  time.  If  alternative 
length  production  lines  were  allowed  at  the  start  of  pro- 
duction, this  driver  may  not  affect  unit  costs.  However,  if 
the  length  of  the  line  is  changed  on  short  notice,  unit 
costs  can  be  adversely  affected  by  crowded  facilities  and 
overused  tools  that  hamper  production  efficiency. 

By  augmenting  a  classical  homogeneous  production 
function  with  a  learning  hypothesis,  the  model  now  to  be 
described  attempts  to  capture  the  above  four  effects  in  an 
estimable  and  analytic  manner.  By  minimizing  the  discounted 
cost  of  production  subject  to  a  production  function 
constraint,  the  model's  output  is  the  optimal  time  path  of 
resource  use.  Since  relative  factor  prices  are  assumed 
constant  over  the  relevant  time  period,  costs  are  measured 
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in  units  of  labor,  the  variable  resource.   Variables  used  in 

the  analysis  are: 

i    .  =  the  sequence  number  of  an  airframe,  i  =  l,2,...,n 
V      =  the  average  number  of  airframes  in  process 


si 


=  the  date  work  begins  on  airframe  i;  work  on  all 
airframes  from  the  same  lot  is  assumed  to  start  on 
the  lot  release  date. 


t,  . 
di 


=  the  delivery  date  for  airframe  i 
q- (t)  =  the  production  rate  at  time  t  on  airframe  i 


Q-(t)  =  the  cumulative  work  performed  on  airframe  i  at 
t  ime  t,  i.e., 


Qi(t)  = 


/ 


si 


q(x)  dx 


x^ (t)  =  the  rate  of  resource  use  at  time  t  on  airframe  i 

6      =  a  parameter  describing  learning  prior  to 
airframe  i 

e      =  a  parameter  describing  learning  on  airframe  i 

Y      =  a  parameter  describing  returns  to  the  variable 
resources 

a      =  a  parameter  associated  with  decreases  in 

productivity  as  an  airframe  nears  completion 

v      =  a  parameter  describing  returns  to  the  length  of 
the  production  line 

p      =  the  discount  rate 

C.     =  discounted  variable  cost  of  a  single  airframe 

The  production   function   is   assumed   to  be  of   the 

following  form: 


q.(t)  =  A(i  -  1/2)6  Q^t)   (tdi  -  t)a  X.lA(t)  Vv   (3.1) 
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where  A  is  a  constant.  The  input  x  is  assumed  to  be  a 
composite  of  many  inputs  whose  rate  is  variable  throughout 
the  production  period. 

This  production  function  is  a  relatively  simple  function 
based  upon  the  four  previously  mentioned  production  cost 
drivers  which  are  combined  so  as  to  conform  with  economic 
theory  and  the  empirically  observed  learning  phenomenon. 
When  analyzing  each  term  of  the  function  individually,  the 

term  (i  -  1/2)   describes  learning  by  doing  in  the  produc- 

e  6 

tion  of  the  ith  airframe.   The  terms  Q.  (t)  and  (t,.  -  t) 

attempt  to  describe  the  effects  of  learning  over  time.   It 

should  be  noted  that  as  the  delivery  date  is  approached,  it 

is  assumed  that  labor  becomes  more  difficult  to  substitute 

for  time  in  the  productive  process  so  it  is  anticipated  that 

1/y 
both  e  and  <*  will  be  between  0  and  1.   Tire  term  xi    (t) 

captures  the  effect  of  production  rate  with  y  expected  to  be 

greater  than  1  and  thus  consistent  with  diminishing  returns 

to  the  variable  resource.   Finally,  the  term  V   attempts  to 

capture  the  effect  of  the  length  of  the  production  line.   It 

is  assumed  that  more  airframes  in  the  same  facility  lessens 

efficiency  so  that  v  should  be  negative  and  small. 

Assuming  a  contract  written  to  induce  a  firm  to  minimize 

its  discounted  costs  of  production,   the  problem  may  be 

stated  as: 
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n      t  ,  . 
■di 


Minimize  C 


■  23    J  «i (*)«_,t 


dt 


(3.2 


i  =  l    t  . 

si 


subject  to: 


1)   q.(t)  =  A(i  -  l/2)6Q.e (t) (tdi  -  t)axi1/Y(t)Vv 


2)   Q.  (t  ,. )  =  1 
l   di 


3)   Ql(t8l)  =  0 


i  =  l,2,...,n 


Since  the  total  cost  of  production  is  monotone  nondecreasing 
and  the  subproblems  are  additive,  the  solution  can  be 
obtained  by  minimizing  each  of  the  subproblems.  The 
representative  problem  for  the  ith  airframe  may  thus  be 
stated  as: 


'di 


Minimize  C 


/U  J. 


(t)e"ptdt 


(3.3) 


t  . 
si 


subject  to: 


1)   q.(t)  =  A(i  -  l/2)6Qie(t) (td.  -  t)axi1/Y(t)Vv 


2)   Q.  (t  ,  .  )  =  1 

'    l   di 


3)   Q.  (t  .  )  =  0 

l  v  si ' 


The  solution  procedure  is   initiated  by   absorbing   the 
constraints  into  the  objective  function.   Solving  the  first 
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constraint       for       x.(t)       yields       the      following      resource 
requirement    function: 

X.(t)     =    qiY(t)A"Y(i    -    l/2)"6YQi"ET(t) (td.     -    t)"aYV"VY 

(3.4) 
After  substituting  into  (3.3)  ,  the  objective  function 
becomes 


Mi 


in  C4-  ^[qJtttA-^i-l^J-^Q.-^ft)  (tdi-t)-^V-v1'e-(,t]dt 

"Si  (3.5) 

To  simplify  the  solution  procedure,  a  transformation  that 
yields  one  state  variable  and  one  control  variable  is  used 
with  the  control  variable  being  the  time  rate  of  change  of 
the  state  variable.   Let 


Z(t)  =  A_1(i  -  l/2)-6V_vQi1-e (t)/(l  -  e)         (3.6) 


This  implies  that 


z(t)  =  A  X(i  -  1/2)'6V  VQ.  e(t)q(t; 


(3.7) 


Thus,  Z(t)  is  the  new  state  variable  and  z(t)  ,  its  time 
derivative,  is  the  control  variable.  Substituting  into 
(3.4)  ,  we  have  an  expression  in  terms  of  the  new  control 
variable ,  i.e., 
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x.(t)    =    zY(t)  (tdi    -    t)    aY 


(3.8) 


When     substituted     into     (3.5),     this    yields     the    following 
transformed    problem: 


tdi 


fcai 


Minimize    C 


!    =     j     [zY(t)(tdi    -    t)~aYe    pt]dt    =      j       I(z,t)dt 


si 


fcSi 


(3.9) 


subj  ect    to  : 


1)       Z(0)     =    0 


2)        Z(tdi)     =    A    1(i    -    1/2)     6V    Vd    -    O 


Since      the      intermediate      function,      I,      does      not      depend 
explicity    upon    the    state   variable,    the   Euler    equation    is 


|*    =    yz^Ct)  (t,.    -    t)-aYe-pt    =    K       . 
3.z  di  o 


(3.10) 


Solving  for  optimal  z(t)  yields 


z(t)  =  Kl(tdi  -  t)Ya/(Y-1)ept/(Y-1) 


(3.11) 


Substituting   this   into   (3.8)   yields   a   solution   to   the 
optimal  time  path  of  resource  use: 


x(t)  =  K1Y(tdi  -  t)aY/(Y-1)eYpt/(Y-1) 


(3.12) 
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This  solution  is  only  of  transient  interest  since  the  value 
of  constant  K,  is  unknown.   An  optimal  expression  for  x(t) 
in  terms  of  the  variables  and  parameters  of  the  original 
problem   is   needed.     To   determine   the   constant   of 
integration,  notice  that 


(t)   =    /  Kl(tdi   "   T)^7^-1^/^-1^   + 


K. 


SI 


(3.13) 

As  this  is  not  an  easy  integral  to  evaluate,  another  trans- 
formation is  useful  to  simplify  the  solution.  Let 
w  =  P(t<3i  -  t)/(y  -  1),  then  ( td  .  -  x)  =  w  (y  -  1)/p  and 
t  =  t,.  -  w(y  -  1)/p.  The  Jacobian  of  the  transformation  is 
J  =  dt/dw  =  - (y  -  1)/p.   Substituting  into  (3.13),  we  have 


f  .  ilT./(T-D      [Ptdl-W(T-1 

-  JK1[ — p — ]  e 


-1)  ]/(y-D 

Jdw  (3.14) 


■/ 


//   i  ,        t   fY«/(Y-l)>  +  l   Pt.-/(Y-D 

ya/  y-1  ry  -  1,  dr         -w, 

-K,  w   /  [— ]  e  e   dw 

1  P 

(3.15) 


Let  K,  =  -K, [ 

3       1     p 


(Y  -  1)   ^a/(Y-1)  }  +  1   Ptdi/(Y-D 


and  we  have 


k3Wit«/(y-1)  e-wdw 


(3.16) 


28 


Now,  the  limits  of  integration  must  be  determined. 
When  x  =  t,  w  =  P(tdi  -  t)/(Y  -  1);  when  t  =  tgi,  and 
w   =    P(tdi    -    tgi)/(Y    -1).       It    now    follows    that 


/ 


p  (t ,  .-t) 
di 


(y-D 

y<*/(y-1)       -w. 


Z    =  K3w'    '   v '       '     e      dw  (3.17) 


(Y-D 


P(tdl-t)  ^di^si* 


(Y-D  (Y-D 

/Y<*/(y-1)     -w,  / 

K^w'    '  '  e      dw    -        / 


„       Yd/(Y-1)     -W, 
K~w  e      dw 


(3.18) 


These  last  two  expressions  can  be  recognized  as  incomplete 
gamma  functions;  the  one  on  the  right  is  always  constant 
since  t  does  not  appear  as  a  variable.   We  now  have 

Z(u)  =  -K3(r[p(tdi  -  tsi)/(Y  -  1),  (yo/(y  -  D)  +  1] 

-  r[p, (Ya/(Y  -  1))  +  1}  +  K4  (3.19) 

where  y  =  p(t-,-  -  t)/(y  -  1).  From  the  constraints  for 
equation  (3.9),  we  know  that  Z(0)  =  0.  It  thus  follows  that 
K.  =  0  so  it  can  be  removed  from  (3.19).   Also  let 
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■K3    =    A    1(i    -     1/2)     6V    V(l    -    O     1T     1[p(tdi    -     tsi)/(Y    -    1), 


(Y«/(Y     -     1)  )     +     1] 


(3.20) 


so  that  Z  also  satisfies  the  final  condition: 


Z(tdi)  =     A  1(i    -    1/2)  6V(tdi)  Vd  -  O 


Also    note    that 

m        dz^)        *r      (tdi-t)1W(Y"1)    -P(tdi-t)/(T-D 
z(t)    =  ^T1  =   K3[p      (Y-i)    ]  e  ("  7-T5 

(3.21) 

After      substituting      for      K^,      the      following      expression      is 

obtained : 


Z(t)     =    A    X  (i-1/2)     6V    V(l-e)     1r    1[p  (tdi-tsi)/(Y-l)  ,  (Y«/(Y-D  >+U 


P(tdi    -    t)     T-/(T-D        _p(t  di-t)/(Y-l)  p 

[      (T     -    1)        ]  S  (Y-^"T)         (3'22) 


This     formulation     for     optimum     z(t)      together     with      (3.11) 
provides    a   direct    solution    for    K,: 


*<]_    =    A    1(i-l/2)     6V    V(l-0     1r    1[P  (tdi-tsi)/(Y-l)  ,  (Yct/(Y-1))+1 


_<P_. 

Y-l 


(Y<*/(Y-1)  )+l       -Ptd./(Y-D 


(3.23) 
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Substitution  for  K1  in  (3.12)  yields  the  following  optimum 
time  path  of  resource  use: 


x.(t)  =  B(i  -  1/2)  Y5v"YV 


-Y 


r    [P  (tdi"tsi)/(Y-1)  '(Ya/(Y-D)   +  1] 


//    U    -Y0  (t-,.-t)/(Y-D 
(tdi"t}  S  (3'24) 


where 


B  =  A-Ul-z)-y[p/(y-l)]{ay2/iy-l))+y 


This   is   the  optimal   time  path   of   resource   use   on   any 
airframe . 

Since  airframe  manufacturing  data  is  generally  recorded 
on  a  monthly  or  quarterly  basis,  the  quantity  of  interest  is 
the  total  resource  used  over  the  appropriate  period.  The 
data  available  for  this  study  are  direct  labor  hours  per 
month  so,  letting  T,  and  T~  represent  the  beginning  and 
ending  dates  for  a  monthly  period,  the  appropriate 
expression  for  airframe  i  is: 


T2 
X.  (T2)  -  Xj^  (Tx)  =   /    x.  (t)dt  (3.25) 

Tl 
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Substituting  for  X .  (t)  using  equation  (3.12),  the  integral 
becomes 


X.(T2)  -  X 


itT,)  =  J       K^t^-t)^/^-1^^-1^ 


(3.26) 
Let  y  =  YP(tdi-t)/(Y-l)  ,  then  y(y-l)/YP  =  (tdi-t)  and  t  = 
tdi  "  y(Y-l)/YP-  Thus,  when  t  =  T2,  y  =  YP  ( td  {-T  2 )  /  (y-1 ) 
and  when  t  =  T,,  y  =  YP ( t ,^-T.) / (y-1) .   It  now  follows  that: 


^(tdi-T2> 
(Y-U 


Xi(T2)-Xi(T1)= 


j  KlTIXl^1^/(-1^"[t-i-X^,/CT-1U 


(y-D 


(3.27) 


where  J  =  dt/dy  =  -(y-1)/yp- 

This    can   be    further    simplified: 


^<tdi-T2) 

(Y-D 
f  Y    Y-1(«T/(T-1))+1    BY(Y_i,     YPtd./(Y-D 

X.(T2)-X.(T1)=       /  -Kj(^)  Y    Y(Y       Je  e    Ydy 


(Y-D 


(3.28) 


=    -D  [  y^/^1 


>     e"ydy 


(3.29) 
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where   D    =    K,  y  i1—) 
1      yp 


(aY/(Y-D  )+l       YPtd./(Y-U 


^<tdi-T2) 
r       (Y-D 


Xi  (T2)-Xi  (Tx)     =    -D 


[ («y/(y-1))+1]-1    e-yd 


Y    " 


^P(tdi-Tl) 
r    (y-D 


[( 


«y/(y-D)+i]-i  e-ydJ 


(3.30) 


In     this      form,      the      incomplete     gamma     function     is     again 
recognizable    and    we    have 


X. (T2)     -    X. (Tx)     =    -D{    r[ 


■-»{ 


^(tdi-T2> 

(Y-D 


r      (0Y/(Y-D)     +    1]     - 


Yp(tdi-Tl} 
"rt    (y-D  '     (a^/(^-1))     + 


Reversing    the    order    of    the    last    two    terms    we    have 


(3.31) 


YP(t       -T    ) 

i(T2)        xi(T1)        D{r[  — (y-1)  ,    («y/(y-D)    +  1]    - 


r[ 


^<tdi-T2) 

(Y-D 


,    (oY/(y-D)    +   i] 


(3.32) 
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Substituting  for  D  and  K,  yields 


Xi(T2)-Xi(T1)  =  A  Y (i-1/2)  y6V  YV(l-e) 


-Y 


r  Y[P  (tdi-tsi)/(Y-D  ,  (YCt/(Y-D  )+l] 

-YPt„./(Y-l) 


(p/(Y-l),Tr[(T«/(T-l))+l] 


dr 


(OY/(Y-D)+l    YPt,./(Y-D 
((y-D/yp)  e 


(3.33) 


This  can  be  simplified  to 


Y.  (T2)-Yi  (Tx)  =  PQ (i-1/2)  Y6V  YV(TlfT2)r  Y  [  p  ( td i -tg • ) / ( y -1)  , 8 1 


{r[ 


YP^di-Tl) 
Y-l 


YP(td.-T2) 

]  -  r[  y°l  ,   8]} 


(3.34) 


where  6Q  =  A"Y(1  -  e, -YT" («t/(T-1) ) -1 

(p/(y_1))y[(y«/(y-1))+1]-(«y/(y-1))+1] 

and  B,  =  (ya/(Y-l)  )  +  1.  This  equation  quantifies  the 
amount  of  the  variable  resource  required  per  month  in  the 
production  of  airframe  i.  Note  that  this  expression  is 
consistent  with  the  assumptions  made  concerning  the 
production  cost  drivers.  This  resource  requirement 
equation,  together  with  the  anticipated  range  of  values  for 
each  parameter  (y  >  1,  0  <_  5  <_  1  r  Oj<e^l,  0^a£l, 
v  <  0) ,    depicts  resource  usage  per  month  on  each  airframe  to 
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be  indirectly  related  to  the  airframe  sequence  number  and 
the  dates  when  work  was  started  and  completed  on  the 
airframe  (representative  of  the  effects  of  learning)  and 
indirectly  related  to  the  number  of  airframes  under  con- 
struction during  the  time  period  (representative  of  the 
effects  of  production  rate) . 

Because  of  the  nature  of  the  data,  it  is  impossible  to 
observe  the  monthly  amounts  of  resources  devoted  to  any 
particular  airframe.  As  reported  in  the  data  set,  what  is 
observable  is  direct  man-hours  per  job  order  per  month. 
This  means  that  the  observed  quantity  is 


LJ  LJ 

J2       [Xi(T2)-Xi(T1)]  =  ^     B0(i-1/2)"Y5V"YV  (TlfT2) 

i=FJ  i=FJ 


YP  (tdi-T.)  YP  (tdi-T2) 

r-ylo(t6i-tsi)/(y-l),Ql]{T[ r73rr-  ,6l]  -  r[ WTTT—   ,8,]} 


(3.35) 
where  FT  and  LT  are  the  sequence  numbers  of  the  first  and 
last  airframes  in  Job  Order  J. 

This  functional  form  represents  the  aggregate  of 
resource  usage  per  month  in  the  production  of  all  airframes 
in  Job  Order  J  and  facilitates  the  generation  of  a  time  path 
of  resource  use.  Using  monthly  labor  hours  and  airframe 
delivery  dates  as  the  variables  in  the  equation,  nonlinear 
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regression  using  Marquardt's  compromise  [Ref.  17]  is  used  to 
generate  estimates  for  the  parameters  of  equation  (3.35). 
When  equation  (3.35)  has  been  fully  parameterized  with  these 
estimates,  substitution  of  job  order  release  and  delivery 
dates  and  airframe  sequence  numbers  allows  prediction  of 
monthly  labor  hour  requirements.  The  following  chapters  are 
devoted  to  reporting  the  empirical  results  of  the  model  and 
assessing  how  well  it  explains  the  data. 
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IV.   THE  DATA 

Based  on  both  its  availability  and  suitability  for 
evaluating  the  model's  potential  as  a  tool  for  a  program 
manager,  cost  data  for  the  F-4  Phantom  II  was  used  in  this 
analysis.  The  F-4  was  designed  and  built  by  the  McDonnell 
Aircraft  Company  of  St.  Louis,  Missouri  in  response  to  the 
Navy's  requirements  for  a  carrier-based  aircraft  capable  of 
fleet  air  defense.  First  flown  in  May,  1958,  the  F-4  became 
the  first  Mach  2-plus  carrier-based  fighter  by  incorporating 
numerous  advanced  designs  and  technologies.  So  impressive 
was  its  performance  that  later  versions  of  the  F-4  were 
purchased  by  both  the  U.S.  Air  Force  and  Marine  Corps  as 
well  as  over  ten  foreign  air  forces.  In  "total,  thirteen 
versions  of  the  F-4  were  produced  with  more  than  4000 
aircraft  delivered  between  1958  and  1979. 

Of  immediate  concern  with  such  an  extensive  and 
heterogeneous  data  base  are  the  interrelationships  between 
different  versions  of  the  aircraft.  In  particular,  the 
extent  of  learning  and  the  effects  on  the  production  rate 
parameter  are  somewhat  obscured  by  having  multiple  versions 
of  the  aircraft  under  simultaneous  production.  While  not 
discounting  this  potential  problem,  the  necessity  for 
resolving   it   is   relieved   by   evaluating   the   model's 
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usefulness  from  the  perspective  of  a  Navy  program  manager 
who  quite  possibly  could  encounter  this  same  problem  in  his 
use  of  the  model.  One  possible  scenario  would  be  where  a 
program  manager  has  cost  data  on  an  early  version  of  an 
airframe  purchased  by  the  Navy  and  must  develop  a  funding 
profile  for  buying  an  improved  version  based  on  the  lot 
release  and  delivery  dates  specified  in  the  manufacturer's 
production  contract.  As  it  would  not  be  unusual  for  the 
early  version  or  the  improved  version  or  both  to  be  produced 
concurrently  with  other  contracts,  it  would  be  useful  to 
know  the  model's  usefulness  in  this  situation. 

The  F-4  program  provides  a  particularly  well  suited  data 
base  for  accomplishing  the  proposed  objective.  The  Navy 
purchased  two  versions  of  the  F-4,  the  F-4B  and  the  F-4J. 
In  all,  660  F-4B  airframes  were  accepted  between  February, 
1958  and  January,  1967  and  552  F-4J  airframes  were  accepted 
between  October,  1964  and  December,  1971.  The  F-4B  cost 
data  will  be  used  as  the  data  base  for  estimating  the 
model's  parameters.  These  data  were  drawn  from  two  sources. 
Direct  man  hours  per  month  for  each  job  order  of  F-4 
production  are  reported  in  the  McDonnell  Aircraft  Company's 
document  "Report  7290,  F-4  Cost  Data"  [Ref.  18].  Aircraft 
acceptance  dates  were  obtained  from  the  OASD  publication 
"Acceptance  Rates  and  Tooling  Capacity  for  Selected  Military 
Aircraft"  [Ref.  19]  and  used  in  lieu  of  delivery  dates  which 


38 


were  not  available.  Since  the  exact  acceptance  dates  were 
unavailable,  for  purposes  of  research,  airframe  acceptances 
were  assumed  to  be  distributed  uniformly  over  the  month  of 
acceptance . 

Several  problems  were  encountered  in  compiling  the  data 
to  use  with  the  model.  The  first  job  order  of  the  F-4B 
production  run  accumulated  in  excess  of  172,000  labor  hours 
before  its  reported  release  date.  These  labor  hours  were 
reported  as  a  lump-sum  which  cannot  be  satisfactorily 
explained.  As  a  result,  these  labor  hours  were  not  used  in 
the  model;  the  data  which  were  used  begin  with  the  month 
that  this  first  job  order  was  released  for  production. 

Each  job  order  also  had  a  small  number  of  manhours 
expended  in  months  after  all  the  airframes  within  that  job 
order  had  been  accepted.  These  hours  were"  aggregated  and 
then  distributed  evenly  throughout  the  preceding  months  of 
the  job  order. 

With  these  adjustments,  233  observations  of  labor  hours 
recorded  over  108  months  in  the  production  of  660  airframes 
remained.  These  observations,  together  with  the  average 
number  of  airframes  under  production  per  month,  form  the 
data  for  study  as  reported  in  the  appendix. 
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V.   EMPIRICAL  RESULTS 

As  formulated  in  Chapter  III,  the  proposed  model  is  that 
manhours  per  job  order  per  month  are  equal  to 


J2      [Xi(T2)-X.(T1)]  =  ^2    S0(i-l/2)  Y6VYV(TlfT2) 


i=F 


i=F 


-Y 


»P(tdl-T1) 


"(tdi-'a' 


r  ,[»(tdl-t,1)/(T-l).»1HP[ ppiT—  -s,]  -  rt rr^T—  ,8,]} 


The   regression   estimates   of   the  model's   parameters   are 
presented  in  Table  I. 


TABLE  I 

PARAMETER  ESTIMATES 

Par  an 

ieter 

Estimate 

8o 

2.509 

el 

3.031 

6 

0.462 

Y 

1.006 

-0.200 


Standard  Error 
0.665 
0.325 
0.024 
0.001 
0.067 
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All  parameter  estimates  are  significantly  different  from 
zero  and  consistent  with  apriori  assumptions.  As  one  of  the 
model's  key  assumptions  is  the  existence  of  an  inverse 
relationship  between  production  rate  and  unit  costs, 
attention  is  first  directed  to  the  estimated  value  for  Y. 
The  estimated  value  of  1.006  indicates  the  existence  of 
decreasing  returns  to  labor  inputs.  That  is,  increases  in 
the  rate  of  production  will  increase  labor  requirements  (and 
hence  unit  costs).  The  estimated  value  of  5  corresponds  to 
a  73  per  cent  learning  curve.  While  this  percentage  may  be 
slightly  low  by  industry  standards,  it  is  not  all  that 
surprising  due  to  the  concurrent  production  of  other  models 
of  the  F-4.  Some  learning  in  the  production  of  these  other 
models  undoubtedly  benefited  the  F-4B  program  and 
contributed  to  the  observed  73  per  cent  learning  curve.  The 
small  negative  value  for  v  confirms  expectations  about  the 
effects  of  facility  size  and  crowding.  8  is  a  scaling 
parameter  and  appears  consistent  with  earlier  studies.  The 
estimated  values  of  8 -,  implies  a  and  e  values  of  0.01  which, 
while  small,  are  within  the  range  of  apriori  assumptions. 

Graphical  analysis  demonstrates  the  time  path  of 
resource  use  generated  by  the  model  to  be  a  reasonable  one. 
Figure  2  illustrates  the  time  path  of  labor  use  predicted  by 
the  model  and  the  actual  labor  hours  used.  Figure  3 
compares  a  90  per  cent  confidence  interval  for  the  predicted 
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labor  hours  with  the  observed  labor  hours.   The  model  does 

2 

fit  the  data  quite  well  as  evidenced  by  the  R   value  of  .76 

obtained  by  squaring  the  XY  correlation  coefficient  reported 
in  Figure  4.  This  figure  shows  that  plotting  the  observed 
values  against  the  predicted  values  yields  approximately  a 
45  degree  line  which  further  illustrates  the  model's  success 
in  explaining  the  variability  of  the  data.  Relatively  large 
and  unexplained  deviations  between  the  observed  and 
predicted  values  are  apparent  during  roughly  the  first  and 
last  thirds  of  the  production  run  (approximately  months 
19-31  and  69-96).  Disassembling  Figure  2  into  individual 
job  orders  (Figures  5-13)  reveals  that  most  of  the  deviation 
noted  during  the  first  third  of  the  production  run  can  be 
attributed  to  Job  Order  692.  This  job  order  is  charac- 
terized by  the  predicted  time  path  lagging"  several  months 
behind  the  observed.  A  factor  of  unknown  significance  is 
that  this  was  the  first  sizable  job  order  to  be  released. 
The  second  area  of  deviation  corresponds  with  a  very  large 
release  of  another  model  of  the  F-4  which  may  have  had 
unpredictable  effects  on  the  regression  output. 

Analysis  of  the  residuals  shows  them  to  be  essentially 
normal  with  no  extreme  outliers  noticeable.  Residual 
analysis  was  conducted  on  two  levels — the  233  observations 
available  before  aggregating  the  nine  job  orders  and  the  108 
observations  formed  by  combining  the  job  orders  into  the 
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time  path  shown  in  Figure  2.  Figures  14-18  depict  the 
larger  set  of  residuals.  These  residuals  generally  appear 
random  .  and  symmetric  with  a  sample  mean  of  0.002  and  some 
positive  skewness  evident.  When  plotted  against  the 
dependent  variable,  the  sign  and  magnitude  of  the  residuals 
do  exhibit  a  slight  positive  relationship  with  the  observed 
amount  of  labor  hours.  The  statistical  table  of  Figure  18 
contains  several  goodness  of  fit  statistics  which  generally 
do  not  contradict,  at  a  .05  significance  level,  a  hypothesis 
of  normally  distributed  residuals.  To  test  for 
heteroskedast ici ty ,  the  residuals  were  divided  in  half  and  a 
hypothesis  of  equal  variances  was  tested  using  an  F  test 
(see  Mood,  Graybill,  and  Boes  [Ref.  20]).  An  F  statistic  of 
1.19  (associated  significance  level  =  0.34)  was  calculated. 
This  supports  the  conclusion  that  the  variance  of  the 
residuals  is  constant.  This  conclusion  is  further  supported 
by  the  lack  of  any  noticeable  pattern  upon  visual  inspection 
of  the  residuals  in  Figures  14-17. 

Similar  analysis  of  the  smaller  set  of  108  residuals 
shows  that  they  also  are  fairly  normal  with  a  sample  mean  of 
0.004.  These  residuals  are  not  as  symmetric  as  the  larger 
set  as  evidenced  by  the  higher  measure  of  skewness  reported 
in  the  statistical  table  of  Figure  21.  While  these 
residuals  are  perhaps  not  as  nearly  normal  in  appearance  as 
the  larger  set,   a  hypothesis   of   normally  distributed 
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residuals  is  again  generally  supported  at  the  .05 
significance  level  by  the  goodness  of  fit  statistics.  In 
this  case,  the  test  for  het er osked as t ic i t y  yielded  an 
F-statistic  of  1.55  (associated  significance  level  =  0.11) 
which  again  supports  a  conclusion  of  constant  variance.  In 
this  case,  however,  there  appears  to  be  a  cyclical  pattern 
in  the  residuals  that  is  most  apparent  in  Figure  19. 

The  cyclical  pattern  noted  above  suggests  that  a  test 
for  autocorrelation  is  in  order.  In  contrast  to  the  larger 
set,  a  test  for  autocorrelation  in  the  aggregated  residuals 
is  meaningful  since  they  are  derived  from  an  entirely 
sequential  time  series.  The  Durbin-Watson  test  (see  Judge 
et .  al.  [Ref.  21])  was  used  to  test  for  first  order 
autocorrelation  in  the  aggregated  set  of  108  residuals  as 
well  as  in  each  of  the  individual  job  orders.  Considering 
the  four  production  cost  drivers  as  the  independent 
variables  and  including  a  constant  term  (i.e.,  K  =  5),  a 
null  hypothesis  of  no  autocorrelation  was  tested  against  an 
alternative  hypothesis  of  positive  autocorrelation.  As 
shown  in  Table  II,  the  Durbin-Watson  test  statistic  was, 
with  but  two  exceptions,  less  than  the  lower  critical  value, 
d  ,  and  thus  indicative  of  a  positive  autocorrelation 
problem.  Since  a  nonlinear  model  was  used,  transformations 
of  the  variables  to  eliminate  this  problem  are  inappropriate 
and  the  autocorrelation  must  therefore  be  included  in  this 
model . 
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TABLE  II 
AUTOCORRELATION  TEST  RESULTS 


Durbin-Watson   Degrees  of         d  ,  d 
Data  Set    Statistic       Freedom    (5%  Significance  Level) 


all  job  orders  0.373  108  1 . 592 , 1 . 758 (approx) 
combined 

Job  Order  687  0.190  34  1.208,1.728 

Job  Order  692  0.163  30  1.143f1.739 

Job  Order  701  0.242  29  1.124,1.743 

Job  Order  713  0.521  22  0.958,1.797 

Job  Order  720  0.436  25  1.038,1.767 

Job  Order  726  1.643  27  1.084,1.753 

Job  Order  731  0.219  26  1.062,1.759 

Job  Order  736  0.368  27  1.084,1.753 

Job  Order  746  0.944  13  0.574,2.094 
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VI .   CONCLUSION 

The  objective  of  the  research  conducted  by  Womer  and 
Gulledge  was  to  incorporate  economic  theory  into  an  airframe 
cost  estimation  model  that  is  estimated  from  historical  data 
and  is  sensitive  to  exogenous  production  schedule  changes. 
Examination  of  the  Womer-Gulledge  model  using  F-4B  cost  data 
indicates  their  approach  to  be  a  valid  and  promising  one. 
The  results  attained  with  their  model  are  certainly 
comparable  to  those  of  other  cost  estimation  models,  and,  at 
the  same  time,  consistent  with  economic  theory  that  other 
models  have  ignored.  This  conformity  with  accepted  economic 
theory  greatly  enhances  the  model's  usefulness  to  Navy 
management  in  planning  and  funding  "  its  aircraft 
acquisitions.  The  model  has  demonstrated  a  sensitivity  to 
production  rate  changes  that  should  enable  a  program  manager 
to  predict  the  effects  of  production  schedule  changes  and  to 
formulate  and  implement  the  most  cost  effective  production 
schedule  available. 

Of  particular  significance  in  evaluating  the  model's 
potential  applications  is  the  consistency  of  its  parameters 
across  quite  different  airframe  production  programs.  The 
parameter  estimates  reported  in  this  thesis  are  quite 
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similar  to  those  attained  by  Womer  and  Gulledge  in  their 
studies  of  the  C-141,  F-102,  and  F-5/T-38  [Ref.  16].  By 
modifying  8  ,  the  scaling  parameter,  to  a  level  appropriate 
for  the  airframe  of  interest,  the  model  can  be  adapted  to 
plan  the  time  path  of  resource  usage  for  a  new  airframe 
before  any  cost  data  have  been  generated  for  the  program. 
As  actual  production  cost  data  become  available,  the 
preliminary  cost  estimates  can  be  updated  and  refined  using 
a  Bayesian  updating  technique  described  by  Womer  and 
Gulledge  [Ref.  16] . 

While  the  model  does  perform  quite  well  and  has  readily 
apparent  applications,  it  is  not  without  flaws.  One  flaw  is 
that  the  model  allows  only  limited  interaction  among 
airframes.  By  assuming  that  all  airframes  in  a  job  order 
are  released  simultaneously,  the  model  does" not  allow  work 
on  an  airframe  to  start  later  than  the  lot  release  date. 
This  may  create  an  artificially  high  production  rate  and 
understate  the  effects  of  learning  over  time.  A  second  flaw 
is  that  the  model  includes  no  cost  penalty  for  the  hiring  or 
firing  of  labor.  Therefore,  the  model  may  predict  that  the 
work  force  should  rise,  then  decline,  and  then  rise  again 
when  hiring/firing  costs  may  render  a  more  moderate  sized 
work  force  more  cost  effective  during  the  relatively  brief 
peaks  and  slumps  in  labor  requirements.  Another  flaw  of  the 
model  is  the  absence  of  any  mechanism  to  adjust  for  the 
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autocorrelation  noted  in  Chapter  V.  The  model  should  be 
modified  to  compensate  for  the  temporal  relationship  in  the 
data. 

While  not  a  flaw  of  the  model  itself,  a  potential 
problem  in  its  implementation  is  data  collection.  The  data 
typically  collected  is  cumulative  labor  hours  per  lot  of 
airframes.  Without  prior  planning,  it  may  be  difficult  to 
acquire  the  data  to  estimate  the  model  accurately  since  the 
model  calls  for  cost  information  on  a  per  airframe  basis. 
In  this  study,  the  model  was  modified  slightly  with  unknown 
effects  on  accuracy  since  the  data  were  aggregated  on  a  job 
order  level. 

Despite  these  imperfections,  the  model  should  be 
considered  a  valuable  tool  for  the  decisionmaker.  Owing  to 
the  intricacies  and  inexactness  of  the  science  of  cost 
estimation,  any  and  all  such  tools  should  be  used  to  improve 
the  decisionmaker's  awareness  of  the  factors  that  can 
affect  a  program's  costs.  As  production  scheduling  does 
matter  as  a  determinant  of  program  cost,  the  model  may 
enable  decisionmakers  to  better  understand  the  implications 
of  funding  cuts,  stretchouts,  and  altered  delivery  schedules 
and,  therefore,  to  make  better  decisions. 
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APPENDIX:   F-4B  DATA  3ASE 

Data  for  each  of  the  nine  F-4B  job  orders  are  listed  with 
one  line  of  data  entered  for  each  month  during  which  work 
occurred  on  a  job  order.   Each  line  contains 

L      T2      D      W      N      H      Tl 
where  L  =  labor  (in  100,000  hours)  for  the  job  order  this  month 
T2  =  end  of  time  period 
D  =  -  of  airframes  delivered  prior  to  this  job  order 
W  =  time  period  when  work  began  on  this  job  order 
N  =  sequence  I  of  the  last  airframe  in  the  job  order 
H  =  average  4    of  airframes  in  house  during  this  period 
Tl  =  start  of  time  period 
After  these  lines,  the  delivery  dates  for  each  of  the  airframes 
in  the  job  order  are  listed. 
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DELIVERY   DATES:  74.25    74.50    74.75    75.07    75.14  75.21    75.29 

75.36    75.43    75.50    75.57    75.64    75.71    75.79    75.86  75.93    76.07 

76.13    76.20    76.27    76.33    76.40    76.47    76.53    76.60  76.67    76.73 

76.80    76.87    76.93    77.08    77.17    77.25    77.33    77.42  77.50    77.58 

77.67    77.75    77.83    77.92    78.12    78.25    78.37    78.50  78.62    78.75 

78.87    79.06    79.12    79.18    79.24    79.29    79.35    79.41  79.47    79.53 

79.59    79.65    79.71    79.76    79.82    79.88    79.94    80.11  80.22    80.33 
80.44    80.55    80.67    80.78    80.89 
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.0 

302 

.0 

83 

.0 

425, 

.0 

202. 

.000 

99 

.0 

2 

.  10908 

101, 

.0 

302 

.0 

83 

.0 

425 

.0 

194. 

.000 

100 

.0 

1. 

.71385 

102, 

.0 

302 

.0 

83 

.0 

425 

.0 

185, 

.500 

101 

.0 

1. 

.86316 

103, 

.0 

302 

.0 

83 

.0 

'  425 

.0 

177, 

.000 

102 

.0 

1 

.33472 

104, 

.0 

302 

.0 

83 

.0 

425 

.0 

168, 

.500 

103 

.0 

1 

.09528 

105 

.0 

302 

.0 

83 

.0 

425 

.0 

159, 

.500 

104 

.0 

0. 

.74063 

106, 

.0 

302 

.0 

83 

.0 

425 

.0 

151, 

.000 

105 

.0 

0, 

.44760 

107 

.0 

302 

.0 

83 

.0 

425 

.0 

143 

.000 

106 

.0 

0. 

.37475 

108 

.0 

302 

.0 

83 

.0 

425 

.0 

241 

.000 

107 

.0 

0 

.64395 

109 

.0 

302 

.0 

83 

.0 

425 

.0 

234 

.500 

108 

.0 

0 

.  13949 

110 

.0 

302 

.0 

83 

.0 

425 

.0 

228 

.000 

109 

.0 

DELIVERY  DATES:    93.16  93.32  93.48  93.64  93.80  94.11  94.22 
94.33  94.44  94.55  94.66  94.77  94.88  95.11  95.22  95.33  95.44 
95.55  95.66  95.77  95.88  96.11  96.22  96.33  96.44  96.55  96.66 
96.77  96.88  97.16  97.32  97.48  97.64  97.80  98.11  98.22  98.33 
98.44  98.55  98.66  98.77  98.88  99.11  99.22  99.33  99.44  99.55 
99.66  99.77  99.88  100.11  100.22  100.33  100.44  100.55  100.66 
100.77  100.88  101.10  101.20  101.30  101.40  101_50  101.60 
101.70  101.80  101.90  102.11  102.22  102.33  102.44  102.55 
102.66  102.77  102.88  103.10  103.20  103.30  103.40  103.50 
103.60  103.70  103.80  103.90  104.10  104.20  104.30  104.40 
104.50  104.60  104.70  104.80  104.90  105.11  105.22  105.33 
105.44  105.55  105.66  105.77  105.88  106.11  106.22  106.33 
106.44  106.55  106.66  106.77  106.88  107.11  107.22  107.33 
107.44  107.55  107.66  107.77  107.88  108.16  108.32  108.48 
108.64  108.80  109.50 
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0.22S36  98.0  425.0  97.0  550.0  216.500  97.0 

0.36007  99.0  425.0  97.0  550.0  210.000  93.0 

0.67462  100.0  425.0  97.0  550.0  202.000  99.0 

0.58518  101.0  425.0  97.0  550.0  194.000  100.0 

0.93599  102.0  425.0  97.0  550.0  185.500  101.0 

1.24208  103.0  425.0  97.0  550.0  177.000  102.0 

1.24028  104.0  425.0  97.0  550.0  158.500  103.0 

1.79210  105.0  425.0  97.0  550.0  159.500  104.0 

1.94067  106.0  425.0  97.0  550.0  151.000  105.0 

2.20895  107.0  425.0  97.0  550.0  143.000  106.0 

3.13~56  108.0  425.0  97.0  550.0  241.000  107.0 

2.05092  109.0  425.0  97.0  550.0  234.500  108.0 

2.44626  110.0  425.0  97.0  550.0  228.000  109.0 

3.01353  111.0  425.0  97.0  550.0  219.000  110.0 

2.31921  112.0  425.0  97.0  550.0  203.500  111.0 

2.24526  113.0  425.0  97.0  550.0  198.500  112.0 

2.46903  114.0  425.0  97.0  550.0  187.500  113.0 

1.70196  115.0  425.0  97.0  550.0  176.000  114.0 

1.51514  116.0  425.0  97.0  550.0  166.000  115.0 

1.59310  117.0  425.0  97.0  '  550.0  155.000  115.0 

0.97395  118.0  425.0  97.0  550.0  145.500  117.0 

0.55454  119.0  425.0  97.0  550.0  135.000  118.0 

0.55339  120. 0  425.0  97.0  550.0  125.000  119.0 

0.15373  121.0  425.0  97.0  550.0  113.000  120.0 

0.17997  122.0  425.0  97.0  550.0  111.500  121.0 

0.05002  123.0  425.0  97.0  550.0  106.500  122.0 

DELIVERY  DATES:   109.12  109.25  109.37  109.50  109.52  109.75 

109.37  110.09  110.13  110.27  110.36  110.45  110.54  110.63 

110.72  110.81  110.90  111.08  111.15  111.24  111.32  111.40 

111.43  111.56  111.64  111.72  111.80  111.38  112.10  112.20 

112.30  112.40  112.50  112.60  112.70  112.80  112.90  113.07 
113.14  113.21  113.28  113.35  113.42  113.49  113.56  113.63 
113.70  113.77  113.34  113.91  114.09  114.13  114.27  114.36 
114.45  114.54  114.63  114.72  114.81  114.90  115.09  115.18 
115.27  115.36  115.45  115.54  115.63  115.72  115.31  115.90 
116.09  116.18  116.27  116.36  115.45  116.54  115.53  115.72 

116.31  115.90  117.16  117.24  117.32  117.40  117.48  117.56 
117.64  117.72  117.80  117.88  118.09  118.18  113.27  113.36 
118.45  118.54  113.63  118.72  118.81  118.90  119.09  119.18 
119.27  119.36  119.45  119.54  119.63  119.72  119.81  119.90 
120.20  120.40  120.50  120.80  121.10  121.20  121.30  121.40 
121.50  121.60  121.70  121.80  121.90  122.50 
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0. 

0 

0 

0 

0 

0 

0 

0 

0 

1 

1 

1 

2 

1 

2 

3 

2 

2 

2 

2 

1 

1 

0 

0 

0 

0 

0 


00429 

01981 
07112 
18193 
22616 
36635 
62820 
66860 
75417 
26485 
37495 
53253 
31180 
11954 
33234 
56218 
88370 
60084 
86669 
03427 
72168 
63850 
97515 
44764 
47514 
41039 
32228 


DEL 
122 
123 
124 
125 
125 
125 
126 
127 
128 
129 
129 
131 
132 


I  VERY 

.77  12 

.56  12 

.36  12 

.  15  12 

.75  12 

.36  12 

.84  12 

.49  12 

.20  12 

.10  12 

.90  13 

.41  13 

.70  13 


108, 

109. 

110, 

111. 

112, 

113 

114 

115 

116 

117 

118 

119 

120 

121 

122 

123 

124 

125 

126 

127 

128 

]_9Q 

130 
131 
132 
133 
134 

DATES 
2.88 
64 
45 
22 
82 
42 
90 
7.56 
8.30 
9.20 
0.26 
1.56 
2.84 


550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 
550.0 


107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 
107.0 


:   122 

123.08 
123.72 
124.54 
125.30 
125.90 
126.48 
127.07 
127.63 
128.40 
129.30 
130.32 
131.70 
133.33 


11 

123 

123 

124 

125 

12  6 

126 

127 

127 

128 

129 

130 

131 

133 


122 
.16 
.80 
.63 
.37 
.06 
.54 
.  14 
.70 
.50 
.40 
.48 
.84 
.67 


22    122, 

123.24 

123 .88 

124.72 

125.45 

126.12 

126.60 

127.21 

127.77 

128.60 

129.50 

130.64 

132.14 


656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.  0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 
656.0 

33  122 

123.32 

124 

124 

125 


126 
126 
127 
127 
128 
129 
130 
132 


09 
81 
52 
18 
66 
28 
84 
70 
60 
80 
28 


241 

234 

228 

219 

208 

198 

187 
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156 

145 

135 

125 

118 

111 

106 

96 

86 

75 

61 

47 

36 

26 

20 

15 

8 

3 


.000 
.500 
.000 
.000 
.500 
.500 
.500 
.000 
.000 
.000 
.500 
.000 
.000 
.000 
.500 
.500 
.500 
.000 
.000 
.500 
.500 
.500 
.500 
.500 
.000 
.500 
.500 


107 

108 

109 

110 

111 

112 

113 

114 

115 

116 

117 

118 

119 

120 

121.0 

122.0 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 


0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 


44  122. 

123.40 

124. 18 

124.90 

125.60 

126.24 

126.72 

12T.35 

127.91 

128.80 

129.70 

131.14 

132.42 


55  122, 

123.48 
124.27 
125.07 
125.67 
126.30 
126.78 
127.42 
128.10 
128.90 
129.80 
131.28 
132.56 
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0. 

,09572 

123. 

.0 

656. 

,0 

122. 

,0 

660. 

,0 
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,500 

122. 

0 

0, 

,04738 

124. 

.0 

656. 

,0 

122. 

.0 

660. 

.0 

96. 

,500 

123, 

,0 

0, 

,05494 

125, 

.0 

656. 

,0 

122. 

.0 

660. 

.0 

86. 

.000 

124. 

.0 

0, 

,08816 

126, 

.0 

656. 

,0 

122. 

.0 

660. 

.0 

75, 

.000 

125. 

,0 

0, 

.  11121 

127, 

.0 

656  . 

.0 

122, 

.0 

660. 

.0 

61. 

.500 

126. 

,0 

0, 

, 14372 

128, 

.0 

656. 

.0 

122. 

.0 

660. 

.0 

47, 

.500 

127. 

.0 

0, 

,20073 

129, 

.0 

656. 

.0 

122, 

.0 

660. 

.0 

36, 

.500 

128. 

,0 

0, 

. 14884 

130, 

.0 

656, 

.0 

122, 

.0 

660, 

.0 

26, 

.500 

129, 

.0 

0, 

.08745 

131, 

.0 

656, 

.0 

122, 

.0 

660, 

.0 

20, 

.500 

130, 

.0 

0, 

.06917 

132, 

.0 

656, 

.0 

122, 

.0 

660, 

.0 

15, 

.000 

131, 

.0 

0, 

.04802 

133 

.0 

656, 

.0 

122 

.0 

660, 

.0 

8, 

.500 

132, 

.0 

0 

.02105 

134 

.0 

656, 

.0 

122 

.0 

660 

.0 

3, 

.500 

133, 

.0 

0 

.04414 

135 

.0 

656, 

.0 

122, 

.0 

660, 

.0 

1. 

.000 

134, 

.0 

DELIVERY  DATES:  132.50  133.50  134.33  134.67 
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